All-at-once preconditioning in PDE-constrained optimization

A Low-Rank in Time Approach to PDE-Constrained Optimization

The solution of time-dependent PDE-constrained optimization problems is a challenging task in numerical analysis and applied mathematics. All-at-once discretizations and corresponding solvers provide efficient methods to robustly solve the arising discretized equations. One of the drawbacks of this approach is the high storage demand for the vectors representing the discrete space-time cylinder...

Lectures Notes Algorithms and Preconditioning in PDE-Constrained Optimization

A preconditioning technique for a class of PDE-constrained optimization problems

We investigate the use of a preconditioning technique for solving linear systems of saddle point type arising from the application of an inexact Gauss–Newton scheme to PDE-constrained optimization problems with a hyperbolic constraint. The preconditioner is of block triangular form and involves diagonal perturbations of the (approximate) Hessian to insure nonsingularity and an approximate Schur...

Towards Matrix-Free AD-Based Preconditioning of KKT Systems in PDE-Constrained Optimization

The presented approach aims at solving an equality constrained, finite-dimensional optimization problem, where the constraints arise from the discretization of some partial differential equation (PDE) on a given space grid. For this purpose, a stationary point of the Lagrangian is computed using Newton’s method, which requires the repeated solution of KKT systems. The proposed algorithm focuses...

Inertia-Revealing Preconditioning For Large-Scale Nonconvex Constrained Optimization

Fast nonlinear programming methods following the all-at-once approach usually employ Newton’s method for solving linearized Karush-Kuhn-Tucker (KKT) systems. In nonconvex problems, the Newton direction is only guaranteed to be a descent direction if the Hessian of the Lagrange function is positive definite on the nullspace of the active constraints, otherwise some modifications to Newton’s meth...